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ABSTRACT 

The Reading Component of the Minneapolis Schools* 
1973-74 Emergency School Aid Act (ESAA) Project vas designed to 
improve reading comprehension among the poorest-reading students in 
eight desegregating public junior highs and the poorest-reading 
junior-high-age students in six nonpublic schools. The Reading 
Component not only met, but surpassed, its objectives for 
comprehension gain among disabled readers. Objective I stated, in 
part, that students with pretest comprehension grade-scores of 0-3.9 
would show a median of 1.5 months comprehension gain for every month 
in the ESAA program; in fact, these students achieved a median gain 
rate of 2.U. Objective II stated, in part, that students entering the 
Component with pretest scores of 4.0-6.0 would have a median rate of 
2.5 months gain per program month; the actual median rate for 
Objective II students was 3.1. Also, within each separate school, the 
ESAA students usually surpassed Objective I and II. In every public 
school approximately 60 percent of the Objective I students exceeded 
the expected median gain-rate of 1.5. Factors possibly accounting for 
differences among schools in gain rates were discussed. 
(Aathor/DEP) 
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The Reading Component of the Minneapolis Schools' 
1973-7^ Hnergency School Aid Act Project: 
An Evaluation 



See Page 

The Reading Component of the Minneapolis Schools' 1973-7^ Einergency 
School Aid Act Project was designed to improve reading comprehension among 
the poorest-reading students in 8 desegregating public junior highs and 
the poorest-reading junior-high-age students in 6 nonpublic schools. 

The Reading Component included (a) a staff of 1^ teachers, 1? teacher 1^-17 
aides, and a full-time Reading Coordinator; (b) a curriculum consisting 
of audiovisual teaching machines and reading materials designed for use 
with such machines; and (c) an in-service training program for the staff. 
The machine-adapted reading materials were the Basic Skill Cente.vs Read- 
ing Program, developed in Minneapolis, and the Dorsett Reading Program, V-9 

During 1973-7^ the Reading Component served 950 students. Those 
7^f7 students with complete pretest, posttest, and attendance data con- 
stituted the evaluation group. The average complete-data student attend- <^^n^ 
ed 87 ESAA class sessions, was absent for I6 sessions, and had an ESAA- 
class attendance rate of 85?^. 

The Reading Component not only met, but surpassed, its objectives 3-4 
for comprehension gain among disabled readers. Objective I stated, in 
parte that students with pretest comprehension grade-scores of 0-3*9 
would show a median of 1.5 months comprehension gain for every month 
in the ESAA program; in fact, these students ach ' ^ved a median gain 17-22 
rate of 2 A. Objective II stated, in part, that students entering the 
Component with pretest scores of A.0-6.0 would have a median rate of 
2.5 months gain per program month; the actual median rate for Objective 
II students was 3.1. Also, within each separate school, the ESAA students 
usually surpassed Objective I and II. In every public school approximately 
60^ of the Objective I students exceeded the expected median gain-rate ^ 
of 1.5. Factors possibly accoimting for differences among schools in 22-24 
gain rates were discussed. 

Recommendations for program improvement included: (a) a complete 
set of machine-programmed materials available to each teacher; (b) a 
full-time person to service Dorsett machines and distribute machine- 
programmed materials; (c) use of a single reading test for all students, 25-27 
with different equivalent forms for pre- and posttest; (d) careful 
consideration of the fact that minority students were overrepresented 
in the ESAA reading programs of some schools. 

The evalaator recommended that continued fimding be sought for the 27-28 
Reading Component. 
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The Reading Component of the Minneapolis Schools' 
1973-7^ anergency School Aid Act Project: 
An Evaluation 

The Reading Component of the Minneapolis Schools' 1973-7^ Energency 
School Aid Act Project was designed to improve reading comprehension among 
junior high students with extremely poor reading skills. The Reading 
Component included a staff of Ik- teachers and 17 teacher aides, a curric- 
ulum consisting of teaching machines and programmed reading materials, and 
an in-service training program for the staff. A full-time Reading Coordi- 
nator, also funded by ESAA, served as a resource for schools partica.pating in 
the Heading Component. During the 1973-7^ school year the Reading Component 
provided remedial instruction for approximately 950 students in both public 
and nonpublic Minneapolis schools. This evaluation studies the reading 
progress and characteristics of those 7^7 ESAA reading students for whom 
both pretest and posttest reading comprehension scores were available. 

Because the Emergency School Aid Act (1972; denoted hereafter as 
ESAA) was designed in part to help solve instructional problems that might 
arise from planned desegregation, the Reading Component operated in those 
eight public junior high schools desegregating as of fall, 1973? Anthony, 
Bryant, Franklin, Jordan, Jefferson, Lincoln, Phillips, and Rairsey. (See 
the 1972 summary of the Minneapolis desegregation plan cited in References.) 
Junior high students in six nonpublic schools also participated in the Read- 
ing Component in 1973-7^: the seventh and eighth grades in Ascension, Holy 
Rosary, Incarnation, St. Joan of Arc, and St. Stephens; and the ninth grade 
at Kegina High. 

Background; The Minneapolis Schools' ESAA Project 

The Reading Component was one of three comprising the Minneapolis 
Schools' ESAA Project. The other Components provided remedial math instruc- 
tion and Desegregation Cotmselor-Aides for jimior high students. The Coimselor 
Aides were employed to prevent or rediice any racial conflict that might arise 
in the desegregating public junior highs. The original plans for each of the 



'At the beginning oi the 1973-7^ school year, the Reading Component also 
provided a teacher, aide, and instructional materials for North High ninth 
graders. In November, however, this teacher and aide were shifted to 
Ramsey Jtmior High, where their services seemed more essential. Most of 
the extremely poor readers at North had already been scheduled for other 
remedial instruction before the ESAA teacher arrived in the fall. 
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three Components are described in the proposal Jor Minneapolis' ESAA Project 
(Office of Planning, Development, and Federal Programs, 1973). 

Among the three Components, the Reading program was considered first 
in priority for funding, ahead of Conflict Resolution (Counselor-Aides) 
and Math. The Reading Component was also the most expensi'^e, costing 
$28^,113 in the public junior highs and also taking the major share of 
the $50,791 allotted to nonpublic schools for reading and math instruc- 
tion. 0-P the total S535i^^l in :iSkA funds awarded to Minneapolis for 
1973-7^, approximately 6o^ went to the Reading Component. 

The priority of each Component for funding was determined by a vote 
of the ESAA Districtwide Advisory Committee, a group constituted in accor- 
dance with ESAA guidelines so as to (a) represent all major racial/ethnic 
groups in Minneapolis and (b) include teachers, students, parents, and 
members of community organizations promoting equality of opportunity. 

ESAA evaluation . The ESAA-Project budget allotted a maximum of 
$10,000 for evaluation. These funds were used to study all three Components — 
Reading, Conflict Resolution, and Math. Th^^ evaluation was conducted by an 
independent contractor, a research psychologist selected by the Research and 
Evaluation Department of the Minneapolis Public Schools. Although the 
evaluator received technical consultation and clerical support from the 
Research and Evaluation Department, the evaluator was not a regular employee 
of the school district. 

The relationship between ESAA and Title I assistance. Seven of the 
ESAA public schools—Bryant, Franklin, Jefferson, Jordan, Lincoln, Phillips, 
and North — also received federal aid in 1973-7if voider provisions of Title I 
of the Elementary and Secondary Education Act. Title I fvmds are uee x to 
aid the compensatory education of disadvantaged students. ESAA funds, to 
aid desegregating school districts, are not necessarily earmarked for com- 
pensatory education, although they may be so used. In Mixmeapolis, the 
ESAA Project did, however, emphasize compensatory reading and math instruc- 
tion. The ESAA students in these schools were a subset of Title I- 
eligible, disadvantaged students, consisting of the lowest achieving 
junior high age students; namely, the lowest achieving 123 students in 
reading, and the lowest achieving 125 students in math. In short, in a 
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school that received assistance from both ESAA and Title I, every ESAA 
student was a Title I-eligible student, but not every Title I student 
was an ESAA student. 

The Organization oi This Evaluation Report 

The following sessions of this report provide answers to four questions 
about the Reading Component: 

1. What were the objectives of the Component? 

2. How did the Component operate? The answer to this question includes 
a description of the Reading Component's curriculum, students, staff, and 
day-to-day operation. The actual operation of the Comppnent is also com- 
pared to the original Troject proposal's prescriptions for program operation. 

3. Was the Component effective in meeting the objectives stated in 
the original Project proposal? Included in the answer to this question' is 
a discussion of factors possibly accounting for differences among schools 
ill their success in meeting Component objectives. 

What recommendations should be made concerning (a) the improvement 
of Component operation and (b) the re-funding of the ESAA Reading Component? 

THE OBJECTIVES OF THE READING COMPONENT 
The Reading Component was designed to improve reading comprehension 
among the poorest-reading students in each ESAA school. In each ESAA 
public junior high, the lowest-achieving 125 "readers" were the target of 
thf^ Reading Component. In the nonpublic ESAA schools, smaller numbers of 
poor readers were selected for the program. Each student selected for the 
ESAA Reading Component was supposed to be two or more reading-comprehension 
years below actual grade placement, as of the start of the 1973-7^ school 
year. Also, no student was to be above the 6.0 grade level in pretest read- 
ing comprehension. 

The specific objectives of the Reading Component, according to the ESAA 
Project proposal, were: 

Objective I ; student f entering the Reading Component with reading- 
comprehension grade-equivalent scores of 3*9 or less will show a median 
gain of 1.5 grade-equivalent-score months for every calendar month in the 
Program. Specifically, (a) will gain at a rate of 2.5 or more grade- 
oqiiivalont months por Program month; (b) 1^ will gain at a rate of 1.7 
to i'.^f, inclusive; find (c) 30^ will /^ain at a ratn of 1.0 to 1.6. Students 
with comprehension levels of 0 to 3*9 were designated Objective I f^tudents. 

9 
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Objective II : students entering the Reading Component with reading- 
comprehension grade-equivalent scores of ^.0 to 6.0 will show a median 
gain of 2.5 or more grade-equivalent-score months for each calendar month 
in the Program. Specifically, (a) 30^ will gain at a rate of ^.0 grade- 
equivalent months per Program month; (b) 1^ will gain at a rate of 2.7 
to 3«9$ inclusive; and (c) 30^ will gain at a rate of 1.0 to 2.6. Students 
with reading comprehension levels of ^.0 or above, but at least two achieve- 
ment-years below their actual grade placement, were designated Objective II 
students. 

THE OPERATION OF THE READING COMPONENT 
This discussion includes a description of the Reading Component's 
innovative instructional approaches; a description of the students and 
their method of selection for the Program; and a description of the 
Component's staffing and day-to-day administration within the schools. 
The role of the teacher aide is described within the third section on 
staffing and daily classroom operation. 

The Reading Component's Innovative Instruct i onal Approaches 

Instruction in the Reading Component emphasized the use of innovative 
curriculum materials usable with the Dorsett M-86 A-V Teaching Machine. 
The Dorsett machine, resembling a small television set, contains a film- 
strip projector and a record player. The Dorsett Company also added a 
cassette player to each machine, to accommddate lessons from the Basic Skills 
Centers Reading Program (see p. 5)* 

Each lesson for an audiovisual teaching machine such as the Dorsett 
consists of both a filmstrip and a synchronized soundtrack. For each frame 
of the filmstrip there is a soundtrack-presented comment or question. If 
a question is asked, the student responds by pressing one of three buttons 
(some machines have five buttons). A correct choice is followed by a sound- 
track presentation of "Yes," "Right," "Correct," or the equivalent, and the 
filmstrip automatically advances. On the Dorsett machine, an incorrect 
choice is followed by a 1-second "error tone," and the correct button must 
then be pressed for the lesson to continue. At the conclusion of the audio- 
visual presentation, the student may complete a brief paper-and-pencil mastery 
test. Each lesson used in the Reading Component generally took 15-20 minutes; 
most students could easily complete two lessons during a class period. 

The above comments on the design and use of the materials generally apply, 



with some exceptions, to both sets of curriculum materials used in the 
Heading Component* These curricula were: 

2 

1. The Basic Skills Centers Reading: Program , developed by Minneapolis 
Schools staff, was first used in the Basic Skills Centers of the Minneapolis 
Public Schools (see Clark, 1972| 1973)- The original ESAA proposal (pp. 17-18) 
specified the Basic Skills Program as the primary curriculum for Objective I 
readers (0-3.9 grade-equivalent level in comprehension). Each lesson in the 
Basic Skills curriculum focuses on a particular "molecular" reading skill, 
or several related skills. With nonreaders, the lessons are used in an 
invariant sequence to develop systematically the primary "phonetic" decoding 
skills of word analysis. Individual lessons in the Basic Skills curriculum 
can also be used in remedial work with readers having specific weaknesses. 
The soundtrack for each Basic Skills lesson was provided by a cassette tape 
synchronized with the accompanying filrastrip. For practical reasons, the 
Basic Skills lessons were used with Dorset t machines, although they can be 
UHed with other teaching machines. 

p. The Dorsett Heading Program (Dorsett Educational Systems, Inc., un- 
dated) was the curriculum originally designed for use with the Dorsett machines. 
According to the original design for the Reading Component (p. 18 of Project 
proposal), the Dorsett Reading Program would be the primary curriculum for 
Objective II readers (^.0 to 6.0 in reading comprehension, but at least two 
achievement-years below their actual grade placement). The Basic Skills 
curriculum discussed above was to be used as a supplement, to remediate specific 
weaknesse ' among Objective II readers. The Dorsett Program, more than the 
Basic Skills Program, emphasizes story reading in the development of reading 
skills. Each Dorsett story is graded according to the comprehension level 
it requires. A number of different skills may be combined in the same high- 
interest Dorsett story. In the Basic Skills Program, however, each lesson 
stresses one specific skill. 

Unforeseen combining of Basic Skills and Dorsett reading lessons . The 
original ESAA proposal specified the Basic Skills Program for Objective I 
students and the Dorsett Reading Program for Objective II students. In 
practice, however, most students used both Dorsett and Basic Skills lessons, 
regardless of their pretest reading level. In addition students used a 

^l''or further current information about the Basic Skills Program, contact 
Mary 0. Kasbolun, Minneapolis Public Schools. 

11 
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variety of other reading materials, not programmed for the Dorsett machine* 

The authors of the Basic Skills materials supported the Pro-ject proposal's 
implied separation of Basic Skill from Dorsett materials. Specifically, 
these authors advocated exclusi't e use of their curriculum for instructing 
Objective I students in the prima^^y decoding skills. The Dorsett materials, 
these authors felt, introduced words and letter combinations in a relatively 
imsystematic manner that might onfuse some unskilled readers. Thus the 
Basic Skills authors recommended that Dorsett lessons be postponed until 
Objective I students had made substan-^ial progress on the Basic Skills 
rraterials (completion of l-iswus below Level 20k at least). 

Once students had graduated to Objective II status (at least ^.0 in 
comprehension) and had presvjnably mastered most primary decoding skills, the 
Basic Skills authors would allow the use of both (a) the commercial Dorsett 
curriculum, to further develop comprehension, and (b) the Basic Skills 
curriculum, to remedy specific decoding weaknesses. 

Table 1 shows the reading materials actually used by 308 -Objective I 
and 355 Objective II students. These students are a subset of the 7^7 students 
with complete test and attendance data (see later tables, such as Table 3). 
Information on materials used was not recorded for I3 Objective I students and 
71 Objective II students with otherwise complete data. Table 1 suggests con- 
siderable mixing of Dorsett and Basic Skills materials. According to this 
table, 85^ of the Objective I students used commercial Dorsett reading lessons 
during at least five different class sessions. The evaluator's observations 
suggest tha*', most Objective I students used commercial Dorsett lessons through- 
out their period of ESAA instruction, and therefore long before they reached 
the 4.0 comprehension level. 

ESAA teachers did not believe the Dorsett lessons should be kept from 
Objective I students. Appendix A is the quesuionnaire answered by all ES^A 
reading teachers. The results, recorded on this sample questionnaire, show 
12 of Ik teachers answering "No" to the question, "Do you think 'commercial 
Dorsett' lessons should be used only with Objective II students...?" In their 
written comments to this question, eight teco/iers said that Dorsett lessons 
provided needed "variety," "interest," or "change of pace" for Objective I 
students. 

Other reading materials . Most ESAA students were easily able to complete 
two machine-programmed lessons (either Basic Skills or Dorsett) per class period. 
The ESAA reading teacher g had the practical problem of finding supplementary 
activities for the remaining class time. All but one of the ESAA teachers 
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therefore supplemented machine-programmed lessons with a variety of 
other materials, categorized in Table 1: 

1. Other commercially prepared reading lessons, readers, or worksheets, 
such as those included in the Job Corps Reading Program (1972), were used 
by 515^ of the Objective I students and 579^ of the Objective II students. 
The Language Master machine, part of the Job Corps Program, was used by a 
few of these students. 

2. Teacher-prepared reading lessons, readers, or worksheets were 
used by approximately three-fourths of the students. The most frequent 
teacher-prepared lesson was some type of vocabulary exercise, including 
crossword puzzles and word recognition worksheets. 

3. Library books and paperbacks (not designed to teach reading and 
having no reading-related questions) were used in all but two or three 
schools. Recent book offerings by commercial publishers include high 
interest biographies with accompanying cassette narrations; ESAA teachers 
used one such series on a trial basis. Table 1 shows that at least SO^ 

of the students read free-choice books of some type during five or more 
E3AA class sessions. 

Other materials used by ESAA students included magazines (including 
reading magazines such as Scholastic Scope ), word games (e.g.. Scrabble, 
Password ), comics, newspapers, and retail catalogs. Approximately 90^ 
of the students used such materials during five or more class sessions. 

Multi-ethnic materials. Since the total ESAA Project was designed 
to help solve any problems associated with Minneapolis' school-desegregation, 
ESAA teachers were asked whether they had used "multi-ethnic" reading 
materials, "designed to promote understanding of, and respect for, different 
racial and ethnic groups" (See Appendix A questionnaire). Seven of the 
1^ teachers indicated they had used such materials. Included among these 
materials were filmstrips and worksheets on American Indian leaders; 
readings and workbooks on Black history; cassettes and stories on minority . 
athletes and women leaders; and Chicano-American poems. No teacher listed 
either the Basic Skills or Dorset t reading programs as an example of multi- 
etlinic materials, although these core curricula of the ESAA Reading Component 
do depict minority persons in a variety of life situations. 

14 
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The ESAA Reading Students : Their Selection and Characteristics 

A preliminary needs assessment based on the 1972 city-wide testing (see 
ESAA Project proposal) showed that each desegregating public junior high could 
expect to have at least 125 students two or more years below grade level in 
comprehension as of fall, 1973; on the average, each school could expect more 
than twice that number. In the nonpublic ESAA schools, projections of students 
two or more years below grade in reading as of fall, 1973 » ranged from 12 to 51 
per school, with a median of 17. In the public junior highs,' therefore, the 
1^^5 poorest readers in each school were the target for the Reading Component. 
Tn thei nonpublic schools, the numbers of ESAA reading students would be much 
smaller. In all cases, ESAA students were to be selected from those two or 
more years below grade level in comprehension (and also at or below the 6.0 
level) . 

Selection of Students . Students entering ESAA reading classes in fall, 
1973> were tentatively designated Objective I or Objective II students by the 
teacher, on the basis of previous test scores and placement recommendations. 
The students then took the comprehension portion of an appropriate-level Gates- 
MacGinitie Reading Test. This comprehension score was used as (a) a check of 
hhr> r,tudent'G appropriate designation as an Objective I or Objective II student 
and (b) a prerLont for the ESAA-Project evaluation. 

Diffcrcmt Gate£5-MacGinitie levels were used to test the comprehension of 
Objective I and Objective II readers: 

1. All junior high students believed to be Objective I readers (0-3*9 grad 
(equivalent level) received the Gates-MacGinitie Primary C, Form 2 (hand-scored) 
Comprehension Test. The Primary C was originally designed for use with third 
graders. 

2. All students believed to be Objective II readers (^.0-6.0, yet at least 
two years below grade level in comprehension) received the Survey D, Form 2, 
Comprehension Test. The Survey D was originally designed for use with grades 

k through 6. Objective II seventh graders (in the 4.0-5.0 cc»nprehension range) 
took the machine-scored version of this test in September, 1973, as part of 
city-wide testing. The eighth and ninth grade Objective II students took the 
hand-scored version of D (answers were written on the booklet instead of a 
machine-scorable answer sheet). 



15 



If the Qates-MacGinitie comprehension score showed a student to be 
disabled in reading but inappropriately designated as Objective I or 
Objective II, then the student was to take the prescribed test (C for 
Objective I students, D for Objective II) to confirm the correct re- 
designation. A number of students, however, particularly Objective I 
students, were not tested according to the above plan. Objective I 
students were to take Primary C for both pretest and posttest, but 
approximately one-half took Survey D as both pretest and posttest. Most 
Objective II students correctly took Survey D, but approximately one-sixth 
took Primary C on both testing occasions. (Only one student took a pretest 
and posttest of different levels; i.e., a C pretest and D posttest.) 

The appropriateness of the tests selected for the ESAA evaluation . 
Contrary to the original testing plan, half of the Objective I students 
took Survey D as both pretest and posttest. In fact, for many Objective I 
students, the D test was probably more appropriate than the C as an in- 
strument to measure comprehension gain. An Objective I student near the 
5. 9 level on the C had little room to gain, since the C grade-equivalents 
only go to 7*0 (for students with near perfect answering). The D test 
ranges from 2.2 to 11.9, giving it a range nearly twice that of the C. 
In short, to the extent that students near or above the ^.0 gva.de level 
were tested with the third-grade C, the low ceiling of the C probably led 
to underestimation of actual reading gain. (Fortunately, only one-sixth 
of Objective II students took the C as pre- and posttest.) 

Pretest comprehension . Table 2 shows the pretest and posttest com- 
prehension test scores of ESAA students. Included in Table 2 are the scores 
of those 7^7 studer^ts having complete test and attendance data: pretest 
score, posttest score, and number of days enrolled. The mean pretest 
comprehension for the 321 Objective I students was 2.9 (standard deviation=*8). 
The mean for the k26 Objective II students was 5*1 s*d*=*8). 

The mean initial reading ability of Objective II students varied some- 
what frOT school to school; the mean initial reading ability of Objective I 
abudents was similar across schools. The range of school means on the pretest 
was therefore smaller for Objective I students (difference of frcsn highest 
school mean to lowest) than for Objective II students (range of l.O). In 
schools with a seventh grade, the poorest (Objective I) readers tended 
strongly to be seventh graders (grade level correlated .^fl with pretest score). 
Object ive II students tended to be eighth and ninth graders. 
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Reading Component guidelines specified, in part, that ESAA students 
would be selected from those below 6.0 in pretest comprehension. In fact, 
% of the ESAA students were above 6.0 on the pretest. The highest pre- 
test comprehension score was 8.1. 

Number of students served by the ESAA Program . Table 3 indicates 
that approximately 950 students were served by the ESAA Reading Component. 
The entries in Table 3 are based only on those 7^7 students having complete 
test and attendance data. Approximately 100 students participated in the 
program in 1973-7^ but (a) did not take the pretest, (b) did not take the 
posttest, and/or (c) did not have available information on number of days 
enrolled. An estimated additional 100 students participated in ESAA reading 
classes at Lincoln Junior High School, but the teacher neglected to make 
available the test and attendance data from these students, despite repeated 
requests by the evaluator. 

In the public junior highs, the mean number of students served was 
slightly over 100 per school. As noted above, the Component had planned 
to serve approximately 125 students per school in 1973-7^. In the nonpublic 
schools the mean number of students served was between 15 and 20 per school; 
only one nonpublic school had fewer than 10 students. 

Attendance . The attendance rate of ESAA students — while not as high 

as the rate for all Minneapolis students in grades seven through nine 
2 

in 1973-7^ — seemed good for a group of potential dropouts. Table 3 in- 
dicates that Objective I students, on the average, attended 9^ ESAA classes 
in 1973-7^ and were absent l8 times. Objective II students attended an 
average of 8l ESAA classes and missed 1^ classes during their period of 
participation in the Reading Component. The somewhat longer period of 
enrollment for Objective I students than Objective II students is attribut- 
able in par^-. to the fact that Objective II students were more likely than 
Objective I students to complete the most advanced reading materials, then 
transferring to another class for the rest of the school year. 

The attendance rate during ESAA-class enrollment was for Objective I 
students and 86?^ for Objective II students. The poorest attendance rate, 

occurred among a group of ESAA students which had a higher proportion 
of American Indians, ^23^, than the ESAA group of any other school. 



"Office of the Chief School Statistician, personal commimication, 
August 9» 197^. 
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Other student characteristics . In most schools, and for the ESAA 
students as a total group, boys outnumbered girls (^7% vs. for the 
total group). When Objective I and II students were combined, nearly 
one-half were seventh graders, one-third were eighth graders, and one- 
fifth were ninth graders. Table 3 also shows that for the total student 
group, 59^ were White American, 30^ were Black American, and 8^ were 
Indian American. Spanish-surnamed students, Asian American students, 
and students identified with other racial/ethnic categories together 
constituted only ^ of the ESAA group. The Minneapolis Public Schools » 
1973-7^ sight count indicates -^hat for grades 7-9 in the city as a 
whole, 8y/o of the students were White, 12^ were Black, k% were Indian, 
were Spanish-surnamed, and 13(> represented other racial categories. 
In every ESAA public junior high, the percentage of minority 
students was higher for the ESAA reading program than for the total 
student body. The percentages of minority students in each ESAA junior 
high ranged from less than 10^ to ^0^. The ESAA programs in three of 
these schools (A, G, and D) had 30~3^^ minority students, however. In 
School D, 5C9^ of the ESAA students represented racial/ethnic minorities, 
while only 25?^ of the student body represented minorities. 
The Staffing and Daily Operation of the Reading Component 

Staffing . Each of the eight desegregating junior highs received 
at least one full-time reading teacher and one teacher aide. Ramsey 
Junior High received two full-time reading teachers (see Footnote 1, p. l), 
Three schools—Anthony, Jefferson, and Franklin — received two teacher 
aides, while Ramsey had three aides. Anthony, Jefferson, and Ramsey 
^were not eligible for other federal assistance to disadvantaged students 
(e.g., under Title I of the Elementary and Secondary Education Act ) , and 
therefore an extra aide seemed necessary. 

The anall number of ESAA-eligible students in participating non- 
public schools led the ESAA Project developers to allocate staff part- 
time, based on the number of extremely poor readers in each school. 
Accordingly, the equivalent of two full-time teachers and one half-time 
teacher-aide was distributed among the six ESAA nonpublic schools. 

In short, the ESAA Reading Component employed 1^ teachers and 17 
teacher aides. The Component had funding for the salary-equivalent of 
11 full-time (seven hours per day) teacher-aide positions. Some of the 
aides and all five of the nonpublic teachers thus worked part-time. 
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Moc;t of th»- staff persons employed in the ESAA Reading Component were 
women (lO of 1^ teachers; 15 of 1? aides). All four minority persons 
working in the ESAA schools (two teachers and two aides) were Black Americans. 

Daily Operation , In each ESAA school, one classroom was designated as 
an ESAA '^compent^atory reading classroom." Each ESAA classroom was equipped 
with Dorse tt machines (approximately 15 in each public junior high; fewer 
in the nonpublic schools). In the public junior highs, each of these class- 
rooms was staffed by the ESAA reading teacher, the ESAA reading aide(s), and, 
in r^ome schools, another reading aide funded under Title I of the Elementary 
,3nd Secondary Education Act. 

In the original design, six ESAA reading classes, with approximately 
20 students per class, were to be held daily in each ESAA public- junior- 
hif;h reading classroom. This original six-class schedule could not be im- 
plemented, however. Under their city-wide contract, Minneapolis teachers 
are required to teach only five classes per day. All public-school ESAA 
teachers taught five ESAA reading classes per day, with the exception of 
two teachers who each taught four ESAA classes and one non-ESAA reading class 
per day. 

While participating in the Reading Component, each student was scheduled 
Into (:Tni:i\ I'or ojk^ period por day. For many KilhA i;tudontfj, the ESAA 

nndinf: clar..s f.ub.stituted for oithor Englir.h or oocial otudioi;; for othor 
i;i:ud(;nijj, the ESAA claGS replace.^d a Gtudy period. Many ctudentc had already 
boon scheduled into English or reading classes when the ESAA program started 
in late September. To constitute ESAA reading classes, students often had 
to be transferred from already established classes. Three ESAA teachers 
had early difficulty obtaining these transfers from ESAA-eligible students. 

The enacted role of the teacher aides in the ESAA reading program . The 
role of the reading aide was only roughly outlined in the Project proposal. 
Since $65,169 had been allotted for public -school reading aides, it seemed 
important to describe both the work of these aides and their reactions to 
the first year of the Reading Component. Appendix B is a questionnaire 
completf?d by all 17 of the reading aides. Responses have been tabulated on 
ihij: .':amplf» quor>ti onnaire . 

App(»ridix r^liowr; thai tho average aide asfjisted filightly over five ESAA 
clru'^rx.t, per day. A ff-w part-time ESAA aidoG assisted non-E^^A classes, and 
oome aideG in nonpublic schools assisted both ESAA reading and ESAA math 
classes. 
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For each of 10 role-related activities, aides were asked (a) whether 
they performed the activity; (b) how they perforaed the activity (including 
any "tips" they would suggest to other aides seeking improved reading per- 
formance by ESAA students); and (c) the percent of total time they spent 
on the activity. The following picture of uhe aide's role emerged. 

Approxiniately one-third of the aides' time was spent interacting direct- 
ly with students. The aides' single most time-consuming activity was "helping 
students to do their work," which occupied one of every five classroom hours, 
on the average. This activity frequently included explaining worksheets, 
reading directions, and drilling students on vocabulary words. A closely 
related activity was "giving feedback to students regarding their classroom 
performance (for example, praising, warning, telling students about their 
progress}." The comments of several aides stressed the i'^portance of being 
sensitive to students' needs for understanding, support, and encouragements 
"Oiar students require tremendous quantities of praise and support," said 
one aide. "Every day some student is particularly upset — remedial students 
need comfort," observed another aide. 

Various clerical tasks, including record-keeping, occupied approximately 
half of the aides' time. These activities included (a) scoring tests, end- 
of-lesson mastery quizzes, and other written materials (15^), (b) maintaining 
up-to-date student records (l09^); (c) organizing and storing the reading 
materials (8^); (d) passing out and monitoring tests and end-of- lesson 
mastery quizzes (7%)', (e) passing out and collecting reading materials (5^); 
(f ) typing and duplicating worksheets and other reading materials; and 
taping narrations to accompany written stories and books. 

Other activities included assisting the teacher in lesson planning (8?S), 
assisting the teacher in finding reading materials to supplement the Basic 
Skills and Dor sett lessons (5?^), making minor repairs on Dorsett machines, 
and obtaining student records and grades from counselors. 

The reading aides did not generally report any role conflict between 
themselves and teachers. When asked, "Do you now perform any duties that 
you feel you should not perform?," 1^ of 17 aides answered "No." When 
asked, "Are there duties you don't perform that you feel you should be per- 
forming as an ESAA Reading Aide?," 15 of 17 aides again answered, "No." Two 
aides felt that their ESAA teacher had given them too much responsibility 
for classroom operation (e.g., "I am teaching too much — the teacher does 
nothing" ) • 
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I^tud ent involx-ement in classroom operation ^ Several aides believe that 
efficiency and .motivation in the ESAA classroom can be increased by involving 
students in the operation of the program. In some ESAA schools students pass 
out and collect materials, select their own Basic Skills and Dorsett programs, 
and keep records of their own progress. 

The Dorsett machine: some mechanical problems ^ Several teachers and 
several aides experienced mechanical problems with the Dorsett machine. 
Some, Lut not all, of these problems, were the result of student vandalism. 
The moving parbG of the machine are accessible to the student: records can 
be scratched, needles can be broken. When students were learning to use the 
macj.inec at the beginning of the year, nearly every ESAA classroom had at 
ler^iit one broken machine. At present there is one Minneapolis school employee 
acGl^jned part-time to the maintenance of the I39 Dorsett machines used in 
thf; Reading Component. These machines represent an investment by the 
Minneapolis Public Schools of nearly $50,000. 

THE EI«TECTIVENESS OF THE READING COMPONENT IN MEETING ITS OBJECTIVES 
Did the ESAA students make those gains in reading comprehension described 
earlier as Reading Component Objectives I and II V Objective I stated, in 
part, that student£3 entering the program at the O-3.9 comprehension level 
would show a median gain of 1.5 grade-equivalent months for every chronological 
month in the prograin. Objective II stated, in part, that students entering at 
the 4.0-6.0 level would gain at a rate of 2.5 grade-equivalent months per 
prograin nonth. 

Before answering this question, one must define rate of comprehension 
rj-iin more precisely. Then, after the main results of this evaluation are 
presented, some factors possibly accounting for differences among schools in 
their i^ain rates will be discussed. 
Dc^fining the Kate of Comprehension Gai n 

The objectives of the Reading Component arc defined in terms of months 
of reading comprehension gain for each month in the ESAA program. For each 
of the 7^7 ESAA students who took both a pretest and, on leaving the prograin, 
a po6btest, gain was measured by first subtracting the px'etest grade-equivalent 
Gcore from the post test grade-equivalent score. This gain score, expressed 
in years gain, was multiplied by 10 to obtain months gain. (The reading test 
norms assume 10 months in a school year.) ^^Months in the program^' was defined 
for each student as the number of enrolled days (including absences) between 
the pretest and the posttest, divided by 18, the number of days in a school 
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month. (The Minneapolis school year has l80 days.) 

For each public jimior high (except Lincoln, whose data were missing) 
mean rates of comprehension gain were obtained separately for all Objective I 
&tude;its and all Objective II students. Data from the six nonpublic schools 
were pooled and two means were calculated: one for all nonpublic Objective I 
students, and the other for all nonpublic Objective II students. 

In the original Project proposal, the reading gain results were to be 
based on (a) only those Objective I students who enrolled in the ESAA read- 
ing class for the entire school year and attended 105 days; and (b) only 
those Objective II students attending at least ^0 school days in 1973-7^. 
(other students could be included in the evaluation if they passed sufficient 
mastery tests from the Basic Skills or Dorsett curriculum.) This restriction 
on eligibility for the evaluation seemed arbitrary to the evaluator. 
Accordingly, the following results are based on all students with ccMnplete 
test and attendance data. 

The effect the approximately 200 missing-data students would have had 
on the results is linknown, but believed by the evaluator to be small. Except 
for the 100 or so Lincoln students, many of the missing-data students pre- 
sumably were minimally involved in the ESAA Reading Component and made minimal 
gains. Since lack of a pre- or posttest implies a short enrollment period, 
however, the gain rates of these students may have been indistinguishable 
from the evaluation group. The evaluator suggests that inclusion of the 
missing-data students would have slightly and imimportantly lowered the 
obtained overall gain rates. 

The Attainment of Reading Objectives I and II 

The Reading Component not only met, but surpassed, its goals for com- 
prehension-gain among disabled readers. Table k shows that Objective I 
students made a median gain of 2.k months of comprehension gain for each month 
in the program; Objective I specified a rate of 1.5 months gain for each 
program month. Table 5 shows that Objective II students made a median gain 
of 3.1 months for each program month; Objective II specified a rate of 2.5 
months gain per program month. 

The objectives of the Reading Component also specified categories of 
comprehension-gain rate that would be attained by different proportions of 
ESAA Gtudents. Objective I had specified that 30!^^ of its students would fall 
into the highest category, 2.5 or more months gain per progi-om month. Tn 
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fact, nearly half of the Objective I students gained at this 2.5 rate. 
Objective II had specified that 30^ of its students would make ^.0 or more 
months gain for each month in the program. The obtained distribution of 
Objective II gain rates showed 399^ of the students in this highest category. 

The lowest category of gain rate — less than one month gain per program 
month — had fewer than expected students. While 25?^ of both Objective I 
and Objective II students were expected to lose ground relative to their 
peers, only 175^ of Objective I students and lk% of Objective II students 
actually had gain rates less than 1.0. 

The obtained reading gain results are, of course, specific to a 
particular age group and testing procedure; these results are not reliably 
jP;onorali2iable to other age groups or testing procediares. 

Furthermore, the obtained gains cannot reliably be attributed to one 
or another single curriculum. The two curricula, Basic Skills and Dorsett, 
were so intermixed that their separate effects could not be determined. 

Some anomalies in the reading comprehension gain results . Difficult 
to explain are two results that emerged from the reading gain data. First, 
a number of students made reading gains so high as to be almost implausible. 
For example, 199^ of the Objective II students and 1% of the Objective I 
students made three or more years raw gain between the pretest and posttest. 
Such large amounts of raw gain, of course, led to extremely high gain rates; 
e.g. 19?^ of the Objective II students and 12?^ of the Objective I students 
made seven or more months gain for every month in the program. A few 
Objective I students and a few Objective II students had gain rates 
^approximating 25 months gain per program month. These extremely high-gaining 
students caused the mean rates of comprehension gain to be higher than the 
median rates, for both Objective I and Objective II students. (The distribu- 
tions of gain rates were positively skewed.) For Objective I students the 
mean rate of months gain per program month was a full month higher than 
the median rate. For Objective II students, the mean rate of h.7 was one- 
and-one-half months higher than the median. 

Second, there was not a close relationship between number of days present 
and pretest-to-posttest gain. In fact, for all students in the ESAA Reading 
Component (Objective I and II students combined) the correlation between 
niamber of days present and reading gain was nearly zero (r:= .01). 

Perhaps a number of factors worked together to produce these strange 
results. For example, the lack of correlation between days present and gain 
may be explained if attendance in ESAA Reading class leads to steady gain up 
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to a certain threshhold of days present, after which further attendance 
produces diminishing returns. In support of this notion of an optimal duration 
for ESAA-program instruction is the fact that relatively high comprehension- 
gain rates tended to be accompanied by relatively low numbers of days present 
(r~ -".^j)- Another explanation for the anomalous gain results is that 
students, usually taking the same test form twice, remembered the compre- 
hension passages fran pretest to posttest. Any remembering of items would 
improve the posttest scores, since students could concentrate on those more 
difficult items they missed on the pretest. 

Further study of these gain anomalies seems important. First, to assess 
the importance of remembering items from pretest to posttest, the gains of 
students taking the same form of a test twice should be compared with the 
gains of students taking different forms for pretest and posttest. Second, 
the reading-comprehension level of these extremely high-gain students should 
be followed up. For example, of the Objective II students and 11?^ of 
the Objective I students had posttest comprehension levels greater than 6.0. 
If the gains of these students are stable and valid, then these students 
Ghould not be future participants in compensatory reading programs like 
ESAA'n, designed for students at or below the 6.0 level. 
Differences Among Schools in Their Gain Rates 

As discussed above, Objective I students and Objective II students, as 
total groups, surpassed their respective reading-gain objectives. In addition, 
the ESAA students within each separate school usually surpassed Objectives I 
and II. Tables h and 5 (pp» 19-20) show that in each public school, the 
Objective I students exceeded their goal of a median 1.5 months gain per 
program month. Five of seven public schools exceeded the median rate specified 
in Objective II; only Schools A and C had median rates less than 2.5 (yet 
close to two months gain per program month). The nonpublic schools, taken 
together, just met Objective I and slightly surpassed Objective II. 

The ESAA schools varied considerably in their comprehension-gain rates. 
For Objective I students, the school median rates ranged from 1.5 (for the 
pooled nonpublic students) to 3-^ (for School D). For Objective II students, 
the highest school median of ^.5 (Schools E and G) was two-and-one-half times 
that of the lowest median (l.8 for School C), 

Three of the ESAA public schools — E, F, and G — had relatively high gain 
rates for both their Objective I and their Objective II students. Not only 
were the means and medians high, but also over 50?^ of the Objective I students 
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and 50^ of the Objective II students attained the highest category of gain 
rate specified in the program objectives; namely, 2.5 or more for Objective 
I students and ^f.O or more for Objective II students. 

Two other public schools-A and C-and the pooled nonpublic schools, 
occupied positions among the lower four ranks for both their Objective I- 
student medians and their Objective Il-student medians. 

In the discussion below, Schools E, F, and G will be called "higher- 
gain schools," and Schools A and C will be referred to as "lower-gain 
schools.'^ 

The Relation of Two Instructional Factors to Gain-Rate Differences Among 
■ jchools 

Two factors that might have accounted for gain-rate differences 
between the three "higher-gain schools" and the two "lower-gain schools" 
were : 

1. Set^aration of Basic Skill f-om Dorsett lessons. In view of the 
recommended exclusive use of the Basic Skills curriculum by beginning 
Objective I students (see pp. 5-6), some might have predicted that the 
^ofTvee of separation of Basic Skills lessons from "commercial Dorsett" 
lessons would be a factor in gain-rate differences. This hypothesis could 
not be tested, however, since in nearly every school the great majority of 
Objective I students used both Basic Skills and Dorsett lessons throughout 
their period of participation in the ESAA Reading Component. One can infer 
only that exclusive use of the Basic Skills curriculum is not a necessary 
condition for the attainment of Objective I, since 6C^o of the Objective I 
median gain rate of 1.5. Among Schools A, C, E, F, and G, the evaluator's 
observations suggest that Schools A, C, and F emphasized Basic Skills 
lessons with Objective I students more than Schools E ^d G. Thus, the 
higher-gain and lower-gain schools did not clearly differ in separation 
of Basic Skills and Dorsett lessons. 

2. The use of supplementary materials . One factor plausibly account- 
ing for some of the observed gain-rate differences was the use of supple- 
mentary reading materials other than Basic Skills or "commercial Dorsett." 
The u.se of supplementary materials seemed a necessity in most classes, 
since students usually had 10-15 minutes left in a class period after 
completing two machine-programmed lessons. Table 1 indicates that one of 
the lower-gain schools-namely , A-used no materials to supplement Dorsett 
and Basic SkiD.ls. In the other lower-gain school (O, every student used 
supplementary materials in each category during five or more class sest^ions. 
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In each of the higher-gain schools (E, F, and G) supplementary materials 
were widely used. For example, in School G students who had finished their 
Basic Skills or Dorsett lessons could select from a smorgasbord of materials: 
paperbacks, library books, retail catalogs, commercial reading lessons, etc. 
The teacher in School G attempted to learn each student's interests (e.g., 
cars, sewing) and brought to class articles and books relevant to those 
interests. She sometimes prepared cassette narratives and worksheets to 
accompany these individualized readings. The combination of Basic Skills 
lessons, Dorsett lessons, and supplementary materisuLs (plus the teacher's 
own reward value for students) seems to have created a particularly potent 
educational environment. A few students, who had completed all of their 
assigned Basic Skills and Dorsett lessons, even attempted to "flunk" their 
Gates-MacGinitie posttest, hoping to remain in the ESAA class. 
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RECOMMENDATIONS 



The following recommendations are of two types: (a) recommendations 
concerning the improvement of Component operation, and (b) recommendations 
concerning the re-funding of the ESAA Reading Component. 

Re commendations for the Improvement of Reading Component Operation 

1. A co mplete set of Basic Skil ls Curriculum lessons and commercial 
Dorset t less ons should be available to each ESAA teacher . While most ESAA 
teachers in 1973-7^ had fairly complete sets of Basic Skills and commercial 
Dorf^ett materials, a number of teachers had gaps in their sets. In part, 
thoBe gaps were due to the fact that the Basic Skills curriculum was not 
complete in. 1973^7^ » and units were (and are) added when written. In the 
nonp^iblic fjchoola, the small number of ESAA students did not warrant compL^te 
r;ot« of materials in each buildr.ng. Nevertheless, one or more additional 
complete sets of Basic Skills and Dorsett materials should be ordered for 

the combined nonpublic schools. The nonpublic schools should also be 
encouraged to develop a more efficient materials-sharing system. In addition, 
another set or two of materials for the public schools should also be ordered 
and kept in a central location, so that individual lessons can be loaned to 
schools having missing or damaged materials. 

2. A full-t ime Minneapolis school employee is needed (a) to service 
the Dorsett machines in the ESAA Reading Component and (b) to maintain and 
di stribute a central invenhory of Basic Skills and comtiercial Dorsett lessons 
(see Recommendation l) . Even if no more machines are purchased, such full- 
time maintenance service seems essential. 

5. Reading materials to supplement the Basic Skills and commercial 
Dors ett lessons should be made available to ESAA teachers . As discussed 
above, mont r.tudents can easily complete two machine-programmed lessons during 
a single class-period, leaving 10-15 minutes available for other activities. 
When asked, "Do you think the ESAA Reading Program should be changed in any 
way next year in your school?*', two-thirds of the ESAA teachers requested 
funds to purchase supplementary materials^ Several of these teachers expressed 
a need for vocabulary materials* Two teachers felt that materials to teach 
writing should be incorporated into the ESAA program. Most teachers requesting 
materials want paperbacks, magazines, reading and word games, etc., that would 
encourage recreational reading by students. The ESAA teachers are generally 
unil f^d in thoir Bupport of the Basic Skills imd Dorsett materials as the core 
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curricula of the Reading Component, but supplementary materials (which do not 
teach decoding) also seem necessary. 

km Supplementary materials (and ne^;^^ developed Dorsett and Basic Skills 
lessons) should be reviewed to insure that they are multi-ethnic . A Ithough 
the objectives of the Reading Component do not specify the use of multi-ethnic 
materials, the adoption of such materials whenever possible would serve one 
purpose of the Emergency School Aid Act; namely, the promotion of interracial 
understanding, 

5. A time-delay feature should be added to the Dorsett machine , so that 
a student who answers incorrectly receives not only a 1-second '^error tone,'^ 
but also a 10 or 15-second '^time-out" period when further responding cannot 
advance the filmstrip. Two ESAA teachers noted that the error tone is not 
aversive for many students. Such students sometimes carelessly pressed the 
machine *s buttons until the correct answer was located, and so progressed 
through the lesson without reading it. A time delay for incorrect answering 
would make random button pressing much more unpleasant and therefore less 
frequent. 

6. The Gates-MacGinitie Survey D, with separate machine-scorable answer 
sheet (Forms IM, 2M, and JH) should be the sole test used for future ESAA 
junior-high evaluations . Forms IM, 2M, and 3M should be alternated to achieve 
a balanced pretest-posttest research design. Survey D, machine-scorable, 
seems to be the test of choice for the following reasons: (a) As discussed 
above. Survey D has a wider range than Primary C, and D scores are therefore 
less restricted by a ''ceiling .effect (b) Seventh graders, who comprised 
nearly half of the ESAA students in 1973-7^ » already take Survey D, Form 2M, 
each September as part of the Minneapolis Schools' city-wide testing program. 
If these D scores are used for the ESAA evaluation, no ESAA seventh graders 
would need to be tested twice in the fall. (c) Machine-scored testing is 
less expensive than hand-scored, since the test booklets can be re-used. 

(d) Several ESAA teachers have noted ironically that the machine-scorable 
D2M, with a separate answer sheet, is faster to score "by hand," with a 
template, than the hand-scored D2. 

7. The ESAA Project staff should carefully consider the fact that 
minority students were over represented in the ESAA reading programs of 
some schools . In three schools the minority enrollment in ESAA classes 
approached 50^ f In one of these schools the ESAA minority enrollment doubled 
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the rate of minority enrollment in the whole student body, ESAA Project staff 
nhould see that educational need is synthesized with the need for racial 
balance, so that unintended resegregation does not occur. 

8. The ESAA reading teachers should more carefully screen incoming 
students to insure that students selected are those for whom the Reading 
Component is intended . Although the great majority of the 1973-7^ ESAA 
students were well suited to the program, T/o had pretest comprehension scores 
above the specified upper limit of 6.0. 

9. As in the past, minority persons should be encouraged to apply for 
positions in the Reading Component . Since no Indian teachers or aides were 
employed for the Reading Component in 1973-7^ » Indian Americans should be 
nought for some of the future staff vacancies. 

10. Futur e evaluation of the Reading Component should include assess- 
mf^nt of its long-term effect on the reading comprehension and reading habit s 

of ^:t:udontG after they have left the ESAA program . Such a follow-up of 1973-7^ 
I«;r,AA Gtudentn would be useful both in making further improvements in the Read- 
ing Component and in documenting its importance. 
Recommendations for the Re-Funding of the Reading Component 

The evaluator believes the Reading Component should be continued. 
The Reading Component is a demonstrably effective program, having not only 
met, but surpassed, its stated objectives of improving comprehension among 
the poorest reading junior high students in Minneapolis. 
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APPENDIX A 



Corw Page 



Minneapolis Pubkic Schools 
ESAA Reading Teacher Fora 



Your name: 



Your school: 



Instructions : 

Please answer the questions on the followirig pages* Your BJiBwere 
will be used (a) to describe how the ESAA Project actually operates, 

(b) to estimate the Project's effectiveness in meeting objectives, and 

(c) to make recommendations for improving the Project • 

Your answers are anonymous. The following code number will be 
used instead of your name to identify your answers: 



This code, known only to the evaluator, will be used to compare 
the answers of all ESAA people at the same school* Names of individuals 
will not appear xn any reports, and your answers will not be identified 
to anyone connected with your employment* 

I do need this cover page with your name (a) to determine who has 
and has not answered the questionnaire and (b) to conduct any needed 
follow-up. 

Do you have any questions? 

Now, please remove this cover page and pass it in* 
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N^17 

M=Mesui 
S.D.r^Standard deviation 
N.A.c^No Annwor 



APPENDIX A (continued) 

Minneapolis Public Schoole 
ESAA Reading Teacher Form 



Tntroductory remarks to Teacher : I have been employed by the Miuneapolis Public 

Schools to help conduct the federally required evaluation of the ESAA Project. 

I wQiild like you to answf»r a few questionr. about the ESAA Heading Program. I 
woulfi aif;o appreciate your auggeations for improvement of the ESAA Raading 
Iroffram. Nara<'fi of individuals will not appear in any reporta, and your 
anewerr. will not bo id'?ntified to anyone connacted with your eaplc^want. 



Uo not fill in 



3 02 



Teacher's code number 



k 1 f'Tfll^' 



10 ? i?'emalf» 



l<(^cv or /ethnic group: 

11 ] ^hitf> American 
2 Mlook American 
Indian American 



0 



0 opanirh-Rurnafflpd American 



nnian ,„orican 

1 fi (m^.fT. Ploaae specify 



How many different liiSAA reading clasBea 

Hid you teach in 197>7'^Y 



Kz:kA S.D.= + 1.2 



I^-l 



Mn:0.8 

S.D.= *i 2.0 



How many other claBPe^ ( not ESAA 
r^'ading clasfier.) did you teach in 

ir)7V7V/ Pleapp de^icribe subject 
content : 



Contact person: 

Paul Higgine, Project Evaluator 
Tel* 3'*S-6lif2 or 61^*0 
Minneapolis Public Schools 
607 N. E. Broadway 
Minneapolis, MN 55^13 



(16) Did you use any •'aulti-ethnic" reading matarialc, 
designed to pronota undarstanding of, and respect 
for, different racial and ethnic groups? 




If your answer was '^Yes," please describe the 
nulti-ethnic utariala: 



(17) Do you think the ESAA Reading Program should be 
changed in any way next year in your fjchool? 



12 



1 



1 Yea 

?. No 

3 Uncertain 



If you anawarad "Yes" or ^'Uncertain," pleaae 
explain : 



t l^ as** ar^ryor th* following two quertions concerning the 
♦operation of t\.f: f^arir 3kill« Curricultam lessons from 

I'hc "f;ofr'n» rr i/jl Dorfj^tt" lernonr: 

,jo 70U think i'nr.ic okillc (Curriculum lessons should 
he n: f*(i only withi Objective 1 ntudents (pretest cora- 
ppf^hr nr iorj ''i.O or below) V 

0_ 1 ycr. 

IT vol} anf'Wpr'd "Mo," ploa.'^e explain; 



^1^/ l o yo'J tliink "commercial Dorsett** lessons should be 
ufiod on'^y with Objective II students (pretest cow- 
preh^^nninn of ^.0 or above)? 

2 1 Yon 
12 No 

you nnrv;' rf-d "No," please explain: , 
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APPENDIX B 



Cover Page 



Minneapolis Public Schools 
ESAA Reading Aide Fora 



Your name; 
Your school: 



Instructions : 

Please answer the questions on the following pages* Your anf^wers 
will be used (a) to describe how the ESAA Project actually operates, 

(b) to estimate the Project *6 effectiveness in meeting objectives, and 

(c) to make recommendations for improving the Project* 

Your answers are anonymous* The following code number will be 
used instead of your name to identify your answers: 







0 


1 







This code, known only to the evaluator, will be used to compare 
the answers of all ESAA people at the same school* Names of individuals 
will not appear in any reports, and your answers will not be identified 
to anyone connected with your employment* 

I do need this cover page with your name (a) to determine who has 
and has not answered the questionnaire and (b) to conduct any needed 
follow-up* 

Do you have any questions? 

Now, please remove this cover page and pass it in* 
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N:::17 APPENDIX B (continued) 

3/7^ „ • J . ... Minneapolis Public Schools 

•'orm S.D ••Standard deviation esAA Keading Aide Form 



Introductory remarks to Aide : I have been employed by the Minneapolis Public 

.T fiool.'. to help conduct the federally required evaluation of the ESAA Pro,ioct. 
i would like you to describe the role of the ESAA Reading Aide. I would 
''il5,o appT^*ciatc your suggestions for improvement of the ESAA Reading iTOfrftm. 
N'amep oi' individuals will not appear in any reports, and your answers will not 
be identified to anyone connected with your employmfnt. 



Do not fill in 



no I 



Aide's code number 



2 
15 



1 y'aU 
i'^'.-male 



i<ace or * thnic group: 

15 1 White /.aierican 

^ ^ ''lack American 

0 'i Trdinn American 

0 h opanish-surnamed American 

0 S Asian American 

0 ^) Other. Pleaae specify: 



1 :^-ii ) 



^12-13) 







=5.2 







M=0.3 
5.0.= + 0.8 



How many different ESAA reading 
clasHes did you assist in 1^73-?'*? 

S.D.r:: + 1.6 



How many other classes ( not ESAA 
reading classes) did you assist in 

1973-7?? Meaiie describe subject 
content: 



Contact person: 

Paul Hiftpins, Project Evaluator 
Tel. ''M^CXh? or (^\hO 
Minneapolis Public Schools 
•807 N. J-J. Broadway 
Kinnfapolis, MN ^>r>^l^i 



(15) Are there duties you don ' t perTorm that you feel 
you should be per formittg at*, an KG/\A f^eadin;^ Aidr^V 
(Are then? thinf^n you don*L do that you .vhould be? 
doing?) 

2 1 Yen 

15 ^ No 

If you answered "Yefi," plea.«:e detxribc the 
acti vititr^: 



(16) Do you think the ESAA Heading Program should be 
changed in any v/ay next year in your school? 



12 



1 Yes 

3 ? No 

2 3 Uncertain 



If you answered "Yes" or "Uncertain," please 
explain : 



•JO w '. r perform any initios that you feel you 

3 1 Yes 

Iff ; \\o 

If vo* 'U; y.-' red ''Yog," please describe the activities: 
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turn w ovT 



orm '♦H 



Thp Hole of the igSAA Re>dinK Aide 

Listed b^Iow are som^ Bctivities Keadinff Aidee might perform. For each 
activity ple«r.e indicate: (a) Do you perform tha activity? (b) How do 
you porfonn the activ^tyV (c) What % of your total time do you spand on 

thin activity? 



Pare P 



Activity 



^ap6ing out and collecting reading 
materialr. of a^l hypes (Banic 
okillfi, Uorrnth, oihera). 



Helping students to do their work 



Pafising out and monitoring teats 
and end-of-l'»«f^on mafttery quiJS^cs. 



.^coring tent; , fnd-of-lesRon 
maptcry qui /'/.en, and other 
written materialfi. 



saving foi^dback to PtudftntR regard- 
ing their clar>«room performance 
(for axtmpla, praising, warning , 
telling studentc about thair 
prograoa K 



Maintaintnrr up-to-dahe student 
r* cordf (for example, lecBon.s 
completed, tf-rt rcores, attendance). 



Orjranizing and titoring the reading 
matcrialfi. 



Arffinting the tna^thor in Holecting 
fifid rinding r*»a(3irig material n to 
fupploment Har.ic okillo and 
l^oraett. le<.?tonr.. 



planninf^. 



Do you perform any other activit- 
ies a- an KUAA Reading Aide? 



Do you perform 
the activity? 





7i9r 




(20) 




7217 





(23) 



15 1 Yea 

2 2 No 




7257 



1 Yas 

2 No 



T26T 



How do you parfora the activity? 
(Include any "tipe" you would glva 
to othar Aides aeeking improvad read- 
ing by tSkk students.) 



Liat tho— "mthar" •ctivitlasi. 



Total 



*/ rter your first answers on this section, you may need to reviaa the *»s, 

no Total iR T^. 



What * of your 
total time do you 
spend on this 
activity? (Round 
to neare st % if ^gy^f^ 

M I sTd. 



5h 



(29-50) 



(31-52) 



|o I l\ 



1 



(35-56) 



I]. 



Tv 5,' 

(TTT 



|0 I 8 1 ^ 



0 5 I* 



7 * 



+1^ 



+ k% 



+129^ 



7^ 



+ 9% 
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(10) l>Cikr« wmUr 



